(19) 




Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



mill 



i 



(12) 



(ID EP1 154 227A1 

EUROPEAN PATENT APPLICATION 



(43) Date of publication: 

14.11.2001 Bulletin 2001/46 



(51) IntCI* G01 B 11/24. G01B 11/02 



(21) Application number: 01 304099 .3 

(22) Date of filing: 04.05.2001 



(84) Designated Contracting States: 


(72) Inventors: 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• Kodama, Seigo, c/o Fuji Machine MFG Co., Ltd. 


MC NL PTSETR 


Chiryu-shi, Aichi-ken (JP) 


Designated Extension States: 


• Okada, Yasushi, c/o Fuji Machine MFG Co., Ltd. 


AL LT LV MK RO SI 


Chiryu-shi, Aiuhi-ken (JP) 


(30) Priority: 10.05.2000 JP 2000137126 


(74) Representative: Moir, Michael Christopher et al 




Mathys & Squire 


(71) Applicant: Fuji Machine Mfg. Co., Ltd. 


100 Gray's Inn Road 


Chiryu-shi, Aichi-ken (JP) 


London WC1X8AL (GB) 



(54) Edge detecting method and edge detecting apparatus 



(57) A method of detecting an edge (1 34, 1 36) of an 
object (28, 130), including the steps of lighting, in each 
one of a plurality of different directions, at least a portion 
of the object, taking an image (120, 122) of the portion 
of the object and a vicinity of the portion which are light- 



ed in the each one of the different directions, synthesiz- 
ing the respective images of the portion of the object 
taken by lighting the portion in the different directions, 
and detecting, based on the synthesized images, an 
edge (134 r 136) of the portion of the object. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to a method and 
apparatus for taking, with an image taking device, an 
image of an object and detecting an edge of the object 
based on image data representing the taken image. 

Discussion of Related Art 

[0002] It is widely practiced to detect a shape, a di- 
mension, and/or a position of an object, by lighting a rear 
or back surface of the object and taking a silhouette im- 
age thereof. In addition, it is also practiced to light a front 
surface of an object and take an image of the front sur- 
face (hereinafter, referred to as "the front-surface im- 
age") of the object. 

[0003] The above-mentioned silhouette-image taking 
method requires that a lighting device be provided in 
rear of the object. Thus, the degree of freedom of the 
image taking device is low. In addition, only an outer- 
most shape of the object can be obtained, although in 
some cases other features of the object may be needed. 
Meanwhile, the above-mentioned front-surface-image 
taking method may suffer a problem that an edge of the 
front-surface image is unclear and accordingly a shape, 
a dimension, or a position of the object cannot be de- 
tected with high accuracy. 

SUMMARY OF THE INVENTION 

[0004] It is therefore an object of the present invention 
to provide an edge detecting method and an edge de- 
tecting apparatus which can detect an edge of an object, 
with accuracy. 

[0005] In a first aspect, the present invention provides 
a method of detecting an edge of an object, said method 
comprising the steps of: 

illuminating an object from a respective one of a plu- 
rality of different directions: 
capturing a plurality of images of said object, each 
image being captured whilst the object is illuminat- 
ed from a respective one of said directions; and 
synthesising said plurality of images and detecting 
an edge of said object therefrom. 

[0006] Preferably, each image includes an image of 
at least a portion of a shadow cast by the illuminated 
object. 

[0007] According to a preferred embodiment of the 
present invention, there is provided a method of detect- 
ing an edge of an object, comprising the steps of lighting, 
in each one of a plurality of different directions, at least 
a portion of the object, taking an image of the portion of 
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the object and a vicinity of the portion which are lighted 
in the each one of the different directions, synthesizing 
the respective images of the portion of the object taken 
by lighting the portion in the different directions, and de- 
5 tecting, based on the synthesized images, an edge of 
the portion of the object. 

[0008] Between a front-surface image of an object 
and an image of a portion of a vicinity of the object that, 
is not lighted by a testing light, that is, an image of a 
10 shadowed portion of the vicinity, there is usually a sig- 
nificant difference in optical characteristic (e.g., lumi- 
nance or hue). Therefore, if the front-surface image of 
the object and the mage of the shadowed portion of the 
vicinity are simultaneously taken, it is possible to accu- 
15 rately detect, by lighting the front surface of the object 
and taking the front-surface image of the object, a por- 
tion of an edge of the object that corresponds to the 
shadowed portion of the vicinity (I.e., a portion of the 
edge that defines a bound between the object and the 

20 shadowed portion). However, to this end, it is needed to 
light the object in a direction inclined relative to a normal 
of an object's surface whose edge is to be detected, and 
accordingly only a portion of the vicinity of the object 
located on one side of the object* surface is shadowed. 

25 Hence, in the present embodiment, an object is lighted 
in each selected one of a plurality of different directions, 
an image of the object and the shadowed portion of the 
vicinity in that state is taken, and the respective images 
taken by lighting the object in the different directions are 

30 synthesized. Thus, an edge of a predetermined portion 
of the object can be detected. For example, in the case 
where an object's surface whose edge is to be detected 
is a rectangular surface, when the object is lighted in 
each one of two directions which are, in a plane which 

35 contains one of two diagonal lines of the rectangular sur- 
face and is perpendicular to the surface, inclined with 
respect to the one diagonal line such that the two direc- 
tions have respective components each of which is par- 
allel to the one diagonal line and which are opposite to 

to each other, an entire edge of the rectangular surface 
that correspond to the four sides of the rectangle can be 
detected. In addition, in the case where a front surface 
of an object has at least one step, each image of the 
object and the vicinity thereof may include a plurality of 

^5 edges. In the latter case, too. any one of those edges of 
the object can be entirely detected by selecting appro- 
priate directions in each of which the object is lighted. 
[0009] Preferably, the detecting step comprises de- 
tecting an entire edge of a surface of the object. 

so [0010] It is preferred that the above- indicated surface 
of the object be a plane surface. However, the above 
subject may be a moderate convex or concave surface. 
That is, the above subject may be any surface which is 
bounded by a clear edge. 

55 [0011] Preferably the surface is a rectangular sur- 
face, the different directions comprise two first directions 
which are, in a plane which contains one of two diagonal 
lines of the rectangular surface and is perpendicular to 
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the surface, inclined with respect to the one diagonal 
line such that the two first directions have respective 
components each of which is parallel to the one diagonal 
line and which are opposite to each other, or two second 
directions which are near to the two first directions, re- s 
spectrvely, and the taking step comprises taking an im- 
age of the portion of the object and a vicinity of the por- 
tion which are lighted in each one of the first or second 
directions. 

[0012] It is preferred that the lighting directions in io 
each of which the object is lighted be the two first direc- 
tions contained in the plane perpendicular to the rectan- 
gular surface. However, the lighting directions may be 
the two second directions which are inclined by respec- 
tive small angles relative to that plane. '5 
[0013] Preferably, the object comprises an electric 
component. 

[001 4] An image of an electric component may be tak- 
en in a slate in which the component is supported on a 
support surface (the support surface preferably has a 20 
dark color, such as blue, brown, or black), or otherwise 
in a state in which the component is sucked and held by 
an end of a suction nozzle. In the latter case, it is pre- 
ferred to provide the suction nozzle with a back plate 
having a dark surface defining a background of the com- 25 
ponent held by the nozzle. 

[0015] In a second aspect the present invention pro- 
vides apparatus for detecting an edge of an object, said 
apparatus comprising: 

30 

illuminating means for illuminating an object from 
one of a plurality of different directions; 
image capturing means for capturing a plurality of 
images of said object; 

control means for controlling said illuminating 55 
means and said image capturing means so that 
each image is captured whilst the object is illumi- 
nated from a respective one of said directions; and 
image processing means for processing said imag- 
es and detecting an edge of said object therefrom. *o 

[0016] Preferably, said image taking means is ar- 
ranged to capture an image including at least a portion 
of a shadow cast by the illuminated object. 
[001 7] According to a preferred embodiment, there is «5 
provided an apparatus for delecting an edge of an ob- 
ject, comprising a plurality of lighting devices each one 
of which lights, in a corresponding one of a plurality of 
different directions, at least a portion of the object: and 
image taking device which takes an image of the portion 50 
of the object and a vicinity of the portion which are light- 
ed by the each one of the lighting devices in the one of 
the different directions; a control device which controls 
the lighting devices and the image taking device such 
that the each one of the lighting devices lights the portion ss 
of tne object in the one of the different directions and the 
image taking device takes the image of the portion of 
the object and the vicinity of the portion lighted by the 



each one lighting device in the one direction; and an im- 
age-data processing device which processes a plurality 
of batches of image data representing the respective im- 
ages taken by the image taking device from the portion 
of the object lighted by the each one of the lighting de- 
vices in the one of the different directions, and detects 
an edge of the portion of the object. 
[001 8] The present edge detecting apparatus can ad- 
vantageously perform the edge detecting method as 
aforementioned. Since the control device automatically 
controls the selection of each of the lighting devices and 
the image taking operations of the image taking device, 
a plurality of images of the object and the vanity can be 
taken easily and quickly. In addition, since the image- 
data processing device automatically detects, based on 
the taken images, an edge of the object, the edge can 
be detected quickly and accurately. 
[0019] Preferably, the edge detecting apparatus fur- 
ther comprises an object holder which holds the object, 
the lighting devices are provided around the object hold- 
er such that the lighting devices are equiangularty 
spaced from each other about the object holder, and the 
image- data processing device detects an entire edge 
of a surface of the object held by the object holder. 
[0020] Preferably, the lighting devices are provided on 
a part-spherical concave surface whose center is locat- 
ed on a centerline of the object holder. 
[0021 ] Since the plurality of lighting devices are pro- 
vided on the part-spherical concave surface, not only an 
azimuth angle but also an elevation angle of each direc- 
tion in which the object is lighted can be changed by 
selecting an appropriate one or more of the lighting de- 
vices. Therefore, in the case where the front surface of 
the object has at least one step, an edge of a surface of 
any step of the object can be easily detected. 
[0022] Preferably the object holder comprises a hold- 
ing head including a suction nozzle which sucks and 
holds the object, and a back plate which has a dark sur- 
face providing a dark background of the suction nozzle. 
[0023] Preferably, the object holder comprises a sup- 
port member having a support surface which supports 
a lower portion of the object. » 
[0024] Since the object is supported by the support 
surface of the support member, a shadow of the object 
is surely formed on the support surface. It is preferred 
that the support surface have a dark color. 
[0025] Preferably, each of the lighting devices com- 
prises at least one light emitting element. 
[0026] Each lighting device may be one which em- 
ploys a single light emitting element, or one which em- 
ploys a plurality of light emitting elements. Each light 
emitting element may be a light emitting diode. 
[0027] Preferably the plurality of lighting devices 
comorise a number of light emitting elements wnich are 
substantially uniformly distributed on a surface and are 
divioed into a plurality of areas each one of which com- 
prises at least two light emitting elements and provides 
a corresponding one of the lighting devices. 
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[0028] Preferably, the light emitting elements belong- 
ing to the each one of the areas are permanently un- 
changeable. 

[0029] In this case, each one of the lighting devices 
can be easily selected, and a drive circuit associated s 
with each light emitting element can be simplified. 
[0030] Preferably, the light emitting elements belong- 
ing to the each one of the areas are changeable. 
[0031] According to this feature, a group of light emit- 
ting elements belonging to each one of the lighting de- to 

vices are temporary, and a portion (one, two but not 

all) of the light emitting elements belonging to one light- 
ing device may be replaced with a portion of the light 
emitting elements belonging to another lighting device. 
Thus, though each lighting device is provided by a plu- *5 
rality of light emitting elements, the direction in which 
the each lighting device lights the object can be finely 
changed. 

[0032] Preferably, the control device comprises a pro- 
gram memory which stores at least one lighting-and-im- 20 
age-taking controlling program to control the lighting de- 
vices and the image taking device; and a processor 
which implements the lighting-and-image-taking con- 
trolling program stored in the program memory. 
[0033] Preferably, the program memory stores a plu- 25 
rality of different lighting-and-image-taking controlling 
programs, and the control device further comprises a 
program selecting means for selecting one of the light- 
ing-and-mage-taking controlling programs stored in the 
program memory. 30 
[0034] According to this feature, the directions in 
which the object is lighted and/or the number of image 
taking operations can be easily changed depending up- 
on a sort of object. 

[0035] Preferably, the image-data processing device 35 
comprises a plurality of image buffers each of which 
stores a corresponding one of the batches of image data 
representing the respective images taken by the image 
taking device; and a synthesizing means for synthesiz- 
ing, based on the batches of image data stored in the *o 
image buffers, the respective images taken by the im- 
age taking device. 

BRIEF DESCRIPTION OF THE DRAWINGS 

45 

[0036] The above and other objects, features, advan- 
tages and technical and industrial significance of the 
present invention will be better understood by reading 
the following detailed description of preferred embodi- 
ments of the invention, when considered in connection so 
with the accompanying drawings, in which: 

Fig. 1 is a front elevation view of an electric-compo- 
nen: mounting system which carries out an edge 
Detecting method to wnicn the present invention is 55 

applied: 

Fig 2 is a plan view of the electric-component 
mounting system; 



Fig. 3 is a cross-sectioned, side elevation view of a 
relevant portion of the mounting system; 
Fig. 4 is an enlarged view of the relevant portion 
shown in Fig. 3; 

Fig. 5 is a diagrammatic view of a control device of 
the mounting system; 

Fig. 6 is a view for explaining a manner in which the 
mounting system takes an image and processes im- 
age data; 

Fig. 7 is a flow chart representing an image-data 
processing program which is carried out by the 
mounting system; and 

Fig. 8 is a view for explaining a direction in which a 
light is emitted to carry out another edge detecting 
method as another embodiment of the present in- 
vention. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS 

[0037] An electric-component (EC) mounting system 
to which the present invention is applied is shown in 
Figs. 1 and 2. The present EC mounting system has the 
same basic construction as that of the system disclosed ' 
in Japanese Patent Document No. 6-291490. First, a 
general construction of the EC mounting system is brief- 
ly described and then, only relevant portions of the same 
are described in detail. 

[0038] In Fig. 1, reference numeral 10 designates a 
bed, on which a plurality of columns 1 2 stand. A station- 
ary frame 14 is fixed to the columns 12, and supports 
an operation panel, etc. As shown in Fig. 2, on the bed 
10 : there is also provided a board conveyor 1B which 
conveys a printed board 16 as a substrate in an X-axis 
direction (i.e., leftward and rightward directions as seen 
in Figs. 2 and 3). The term "printed board" is used to 
refer to both a printed "wiring" board on which no ECs 
have been mounted, and a printed "circuit" board on 
which ECs have been mounted. The printed board 16 
which is conveyed by the board conveyor 1 8 is posi- 
tioned and supported at a prescribed position by a board 
positioning and supporting device, not shown. 
[0039] A feeder-type EC supplying device 20 and a 
tray-type EC supplying device 22 are provided on both 
sides of the board conveyor 18 in a Y-axis direction per- 
pendicular to the X-axis direction on a horizontal plane. 
The feeder-type EC supplying device 20 includes a 
number of feeders 24 which are arranged in the X-axis 
direction. Each feeder 24 feeds an EC carrier tape. The 
EC carrier tape includes an EC accommodating tape 
which has a number of EC accommodating pockets ar- 
ranged at a regular interval of distance in a lengthwise 
direction thereof and carries a number of ECs accom- 
modated in the pockets, respectively; and a cover tape 
which is adhered to the accommodating tape to close 
respective openings of the pockets thereof so that at the 
time of feeding of the EC carrier tape, the ECs are pre- 
vented from jumping out of the pockets. Each feeder 24 
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feeds the EC carrierlape at a predetermined pitch in the 
Y-axis direction, while peeling the cover tape from the 
EC accommodating tape. Thus, each EC is fed to an 
EC-supply portion of each feeder 24 as an EC-supply 
position of the feeder-type EC supplying device 20. 
[0040] The tray-type EC supplying device 22 includes 
a number of trays each of which holds a plurality of ECs. 
As shown in Fig. 2, the supplying device 24 includes a 
number of tray accommodating boxes 26 each of which 
accommodates a plurality of trays. The tray accommo- 
dating boxes 26 are supported by respective support 
members, not shown, and are sequentially moved to a 
prescribed EC-supply position by an elevating and low- 
ering device and a moving device, both not shown, 
which are provided in one of the columns 12. The EC- 
supply position is prescribed at a position which is near- 
er to the board conveyor 18 than a waiting position 
where the boxes 26 wait in a vertically stacked state. 
Above one box 26 being positioned at the EC-supply 
position, a predetermined head-movement space is pro- 
vided for a mounting head 60, described later, to move 
and take ECs from the trays of the one box 26. One box 
26 which accommodates one tray storing one or more 
ECs to be supplied next, is moved in a horizontal direc- 
tion from the waiting position to the EC-supply position 
where the one box 26 supplies the EC or ECs. After the 
one box 26 has finished supplying the EC or ECs, the 
one box 26 is returned horizontally to the waiting posi- 
tion, before the next box 26 is moved to the EC-supply 
position, and then is retracted (i.e., moved upward) to a 
waiting space which is provided above the waiting po- 
sition. 

[0041 ] ECs 28 (Fig. 1 ) which are supplied by the feed- 
er-type EC supplying device 20 and/or the tray-type EC 
supplying device 22 are mounted on the printed board 
16 by an EC mounting device 30 which is provided on 
the bed 1 0. As shown in Fig. 1 , two guide rails 32 which 
extend in the X-axis direction are provided, on the bed 
1 0, on both sides of the board conveyor 1 8 in the Y-axis 
direction, and an X-axis slide 34 fits on the guide rails 
32 via respective guide blocks 36 such that the X-axis 
slide 34 is movable in the X-axis direction. 
[0042] As shown in Fig. 2, the X-axis slide 34 has a 
length extending from the feeder-type EC supplying de- 
vice 20 to the tray-type device 22 over the board con- 
veyor 18 and two nuts 38 (only one nut 28 is shown in 
Fig. 3) are fixed to the X-axis slide 34. The two nuts 38 
are threadedly engaged with two ball screws 40, respec- 
tively. When the two ball screws 40 are rotated in syn- 
chronism with each other by two X-axis servomotors 42, 
respectively, the X-axis slide 34 is moved in the X-axis 
direction. 

[0043] On the X-axis slide 34. a Y-a>:is slide 44 is oro- 
vioed such thai the Y-axis sliae 44 is movable in the Y- 
axis direction perpendicular to the X-axis direction on 
tne horizontal plane. As shown in Rg. 3. the X-axis slide 
34 has a vertical surface 46 to which a ball screw 48 
which extends in the Y-axis direction is fixed, and a nut 



50 fixed to the Y-axis slide 44 is threadedly engaged with 
the ball screw 48. When the ball screw 48 is rotated by 
a Y-axis servomotor 52. shown in Fig. 2, via gears 54, 
56, the Y-axis slide 44 is moved in the Y-axis direction 
s by being guided by a pair of guide rails 58. 

[0044] As shown in Fig. 3, the Y-axis slide 44 supports 
a mounting head 60 such that the head 60 is not mov- 
able relative to the Y-axis slide 44. The mounting head 
60 includes a nozzle holder 64 which is vertically mov- 
*0 able, and rotatable, and a suction nozzle 62 is attached 
to the holder 64 such that the nozzle 62 is detachable 
from the holder 64. The suction nozzle 62 applies a neg- 
ative-pressure air to an EC 28 and thereby holds the 
same 28. The suction nozzle 62 includes a back plate 
'5 63 having a dark surface providing a dark background 
of the EC 28 held by the nozzle 62. The mounting head 
50 additionally supports a fiducial-mark (F-mark) cam- 
era 66 (Fig. 2) which takes respective images of fiducial 
marks (F-marks) as positioning reference marks provid- 
ed on the printed board 16, in such a manner that the 
F-mark camera 66 is not movable relative to the head 
60. The F-mark camera 66 is a CCD (charge-coupled 
device) camera including a matrix of CCDs defining an 
image-take surface. 

[0045] As shown in Figs. 2 and 3, two lighting devices 
70 : and two EC cameras 72 each as an image taking 
device are fixed to the X-axis slide 34. One of the two 
lighting devices 70 and one of the two EC cameras 72 
are provided between the feeder-type EC supplying de- 
vice 20 and the board conveyor 1 8; and the other lighting 
device 70 and the other EC camera 72 are provided be- 
tween the tray-type EC supplying device 22 and the 
board conveyor 18. Respective brackets for fixing the 
two lighting devices 70 to the X-axis slide 34 are not 
shown for easier understanding purposes only. The one 
lighting device 70 and the one EC camera 72 are pro- 
vided on a portion of the X-axis slide 34 between the 
feeder-type EC supplying device 20 and the board con- 
veyor 1 8; and the other lighting device 70 and the other 
EC camera 72 are provided on another portion of the X- 
axis slide 34 between the tray-type EC supplying device 
22 and the board conveyor 18. 
[0046] As snown in Fig. 4, each of the two lighting de- 
vices 70 has a hollow hemispherical shape, and opens 
upward. Each of the two lighting devices 70 is provided 
such that a center of a circle defined by the upper open 
end of the hollow hemisphere is located above a corre- 
sponding one of the two EC cameras 72. A number of 
light emitting diodes (LEDs) 74 are provided on an inner 
surface of the hollow hemisphere such that the LEDs 74 
are substantially uniformly distributed over the inner sur- 
face. Those LEDs 74 are divided, in advance, into a plu- 
rality of lighting areas, which are connected to a olurality 
of switches 76 (Fig. 5), respectively so that all the LEDs 
74 of each of the lighting areas are simultaneously 
turned on and off. independent of the LEDs 74 of the 
other lighting area or areas. In the present embodiment, 
each lighting area is a small strip-like area having a wide 



25 



30 



35 



40 



45 



50 



55 



9 



EP 1 154 227 A1 



10 



elevation angle, and a narrow azimuth angle, as viewed 
from the EC 28 held by the suction nozzle 62. More spe- 
cifically described, each lighting area include five LEDs 
74 in its wide elevation angle and two LEDs- 74 in its 
narrow azimuth angle, i.e.. ten LEDs 74 in total. Thus. 5 
the ten LEDs 74 cooperate with one another to provide 
one lighting unit which is connected to one switch 76. 
[0047] Since each lighting device 70 opens upward 
as described above, the inner surface of the hollow hem- 
isphere faces the EC 28 as an object whose image is to 10 
be taken. Each lighting device 70 as the light source has, 
in a bottom thereof, a circular aperture 78. Below each 
of the two lighting devices 70, a corresponding one of 
the two EC cameras 72 is provided such that the one 
EC camera 72 is oriented in a vertically upward direc- *5 
tion, so that the one EC camera 72 can take an image 
of the EC 28 positioned above the each lighting device 
70 through the aperture 78. Each of the two EC cameras 
72 is provided by a CCD camera, and cooperates with 
a corresponding one of the two lighting devices 70 to 20 
provide a lighting and image-taking device 80 which 
takes an image of the EC 28. 

[0048] The present EC mounting system includes a 
control device 100 shown in Fig. 5. The control device 
100 is essentially provided by a computer including a 25 
central processing unit (CPU) 1 02, a read only memory 
(ROM) 104, a random access memory (RAM) 106, and 
a bus 108 which couples those elements 102, 104, 1 06 
to one another. An image-input interface 110 is coupled 
to the bus 118, and the F-mark camera 66 and the two 30 
EC cameras 72 are connected to the image-input inter- 
face 110. A servo interface 112 is also coupled to the 
bus 1 08. and the X-axis servomotors 42. the Y-axis ser- 
vomotor 52, a Z-axis servomotor 113 which elevates 
and lowers the nozzle holder 64 and the suction nozzle 35 
62, and a 6 -axis servomotor 114 which rotates the hold- 
er 64 and the nozzle 62 are connected to the servo in- 
terface 112. In addition, a digital-input interface 115 and 
a digital-output interface 1 1 6 are also coupled to the bus 
108, and the board conveyor 18, the feeder-type and *o 
tray-type EC supplying devices 20, 22, and the other 
portions of the EC mounting device 30 than the above- 
described servomotors are connected to the digital-out- 
put interlace 116. Moreover, the lighting devices 70 are 
connected to the interface 116 via the switches 70. 
[0049] The ROM 1 04 storas various control programs 
including an EC mounting program which is used by the 
computer to mount the ECs 28 on the printed board 1 6, 
and an image processing program whicn will be de- 
scribed later. 50 
[0050] Next, the operation of the EC mounting system 
constructed as described above will be describee. Since 
the EC mounting operation of the present system is de- 
scribed in detail in the above-indicated Japanese Patent 
Document No. 6-291490. the EC mounting operation is 55 
just briefly described, and an image processing opera- 
tion of the present system are described in detail. 
[0051] In the EC mounting operation, first, the X-axis 



slide 34 and/or the Y-axis slide 44 is/are moved to con- 
vey the mounting head 60 to the EC-supply position of 
the feeder-type or tray-type EC supplying device 20, 22 
where the mounting head 60 or the suction nozzle 62 
holds one EC 28 supplied by the supplying device 20, 
22. After the suction nozzle 62 is lowered and is con- 
tacted with the EC 28 by an elevating and a lowering 
device which includes the Z-axis servomotor 113 as its- 
drive source, a negative-pressure air is supplied to the 
nozzle 62 so that the nozzle 62 sucks and holds the EC 
28 and subsequently the nozzle 62 is moved upward. 
[0052] The mounting head 60 or the suction nozzle 
62 holding the EC 28 is moved, along a straight line con- 
necting between the EC-supply position of the feeder- 
type or tray-type EC supplying device 20 or 22 and a 
prescribed EC-mount place on the printed board 16, 
from the EC-supply position toward the EC-mount 
place. During this movement, the mounting head 60 is 
stopped at a position above either one of the two lighting 
and image-taking devices 80 that is fixed to a portion of 
the X-axis slide 34 between the EC-supply position and 
the EC-mount place. Wherever the EC-supply position 
may be on the feeder-type or tray-type EC supplying de- 
vice 20 : 22, or wherever the EC-mount place may be on 
the printed board 16, the mounting head 60 must move 
in the Y-axis direction on the X-axis slide 34 and pass 
over, for moving from the EC-supply position to the EC- 
mount place, one of the two lighting and image-taking 
devices 80. Therefore, the mounting head 60 is stopped 
at the position above the one lighting and image-taking 
device 80. 

[0053] At that time, the control device 1 00 selects, ac- 
cording to the image processing program stored in the 
ROM 1 04, appropriate ones of the LEDs 74 of the light- 
ing device 70 of the above- indicated one lighting and 
image-taking device 80, operates the selected LEDs 74 
to emit light toward the EC 28 held by the suction nozzle 
62, and operates the EC camera 72 of the one device 
80 to take an image of a front surface of the EC 28 and 
a vicinity of the EC 28 each time appropriate LEDs 74 
are selected and operated to emit light toward the EC 
28. After all image taking operations have been finished 
on one EC 28, the mounting head 60 is moved to the 
EC-mount position where the EC 28 held thereby is 
mounted on the printed board 16. During this movement 
of the mounting head 60, the control device 100 proc- 
esses batches of image data representing the images 
taken from the EC 28, and detects an edge of the EC 
28. Moreover, the control device 1 00 determines, based 
on the detected edge of the EC 28, one or more posi- 
tional errors of the EC 26 relative to the suction nozzle 
62, then operates, based on the determined positional 
errors of the EC 28, the 0 -axis servomotor 1 1 4 to rotate 
the nozzle holder 64. and the X-axis and Y-axis servo- 
motors 42, 52 to move the mountinc head 60. so that 
the EC 28 held by the nozzle 62 is accurately mounted 
at the EC-mount position on the printed board 16. Next, 
there will be described the operations of the EC mount- 
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ing system according to the image processing program. 
[0054] All the LEDs 74 of each of the two lighting de- 
vices 70 are divided into a plurality of predetermined 
lighting areas, depending upon the EC 28 held by the 
suction nozzle 62. As shown in Fig. 6, the control device s 
1 00 sequentially operates the LEDs 74 of each one of 
the predetermined lighting areas to emit light toward the 
EC 28. Fig. 6 shows the EC 28 and the lighting device 
70, upside down, for easier understanding purposes on- 
ly. The image processing program includes, for a sort 10 
and/or a shape of each EC 28, control data to divide the 
LEDs 74 into a plurality of predetermined lighting areas 
and operate the lighting areas to sequentially emit light 
in a predetermined order. In the present embodiment, 
since the EC 28 has a rectangular surlace, the LEDs 74 is 
are divided into four lighting areas each of which lights 
the EC 28 in a corresponding one of four directions 
which are perpendicular to the four sides of the rectan- 
gular surface, respectively. When a first one of the four 
lighting areas is operated to emit light, a shadow of the 20 
EC 28 is formed in a portion of a vicinity of the EC 28 
that is located on one side thereof opposite to the first 
lighting area, so that the EC camera 72 takes an image 
120 of the EC 28 and an image 122 of the shadowed 
portion of the vicinity of the EC 28. in Fig. 6, the image 25 
1 20 of the EC 28 is indicated at broken line, because an 
image of the other portion of the vicinity of the EC 28 
than the shadowed portion may be light and a bound 
between that image and the image 120 of the EC 28 
may be unclear. Thus, the image 122 of the shadowed 30 
portion is significantly dark as compared with the image 
120 of the EC 28 and the image of the other portion of 
the vicinity of the same 28. A batch of image data rep- 
resenting the thus taken image including the images 
120, 122 is stored in one frame buffer of the RAM 106 35 
of the computer. Then, likewise, a second, a third, and 
a fourth lighting area are sequentially operated to emit 
light toward the EC 28, so that the EC camera 72 takes 
an image of the EC 28 which is lighted by each one of 
the second, third, and fourth lighting areas, and respec- *o 
tive batches of image data representing the thus taken 
images are stored in respective frame buffers of the 
RAM 106. 

[0055] Next, the tour batches of image data are su- 
perposed on one another to produce a single synthe- 4 * 
sized image. In the present embodiment, since the EC 
28 and the EC camera 72 are not moved relative to each 
other while the four images of the EC 28 are taken, a 
synthesized image can be easily produced by simply su- 
perposing the four images on one another. In fact, as so 
illustrated in the bottom portion of Fig. 6, a synthesized 
image is produced which includes (i) a dark imago as a 
set of four shaaowed-portion images 122 obtained by 
the four image-taking operations, and (ii) a light image 
of tne rectangular surface of the EC 28 that is surround- 55 
ed by the dark image. A bound between the dark image 
and the light image is detected as an entire edge of the 
rectangular surface of the EC 28 and, based on the de- 



tected edge of the EC 28, positional errors (e.g., a rota- 
tion-position error and two center-position errors) of the 
EC 28 relative to the suction nozzle 62 are determined. 
The rotation-position error is an error of a rotation or an- 
gular error of the EC 28 relative to the nozzle 62 aoout 
an axis line of the nozzle 62; and the two center-position 
errors are respective errors of a predetermined center 
position of the EC 28 relative to the nozzle 62 in the X- 
axis and Y-axis directions. Based on the thus deter- 
mined positional errors of the EC 28, the control device 
100 controls the 6 -axis servomotor 114 as the drive 
source of the rotating device to rotate the nozzle holder 
64 and the suction nozzle 62 to correct the rotation-po- 
sition error, and controls the X-axis and Y-axis servomo- 
tors 42, 52 to move the mounting head 60 to correct the 
center-position errors, so that the EC 28 is accurately 
mounted on the printed board 1 6. 
[0056] Next, the image processing program will be de- 
scribed by reference to the flow chart of Fig. 7. This pro- 
gram is iteratively carried out during the operation of the 
EC mounting system. 

[0057] First, at Step S1 (hereinafter, simply referred 
to as S1 ; this applies to the other steps), the control de- 
vice 100 judges whether Flag, F, is set at F=0. In a first 
control cycle according to this program, Flag F remains 
at F=0 and accordingly a positive judgment is made at 
S1. Then, the control goes to S2 to judge whether an 
image of the EC 28 can be taken by the EC camera 72. 
In the present embodiment, in a state in which the 
mounting head 60 is stopped at the position right above 
either one of the two lighting and image-taking devices 
80, a stop signal is produced and, when the stop signal 
is produced, the control device 1 00 judges that an image 
of the EC 28 can be taken. If no stop signal is produced, 
a negative judgment is made at S2, and the current con- 
trol cycle according to this program is terminated. On 
the other hand, if the stop signal is produced, the control 
proceeds with S3 to change Flag F to F=1. In each of 
subsequent control cycles according to this program, S2 
and S3 are skipped until all the operations for the current 
EC 28 are finished. 

[0058] Next, at S4, the control device 100 operates a 
lighting area, n (=1 , 2, 3, or 4), of the above-explained 
predetermined lighting areas that corresponds to a se- 
quential number n, to emit light. In the current control 
cycle, the seoucntial number n is equal to an initial val- 
ue, i.e., 1 . Thus, the first lighting area is operated to emit 
light toward the EC 28 and, at S5, the EC camera 72 is 
operated to take an image of the EC 28 and a vicinity 
thereof. A batch of image data representing the thus tak- 
en image is stored in a frame buffer of the RAM 1 06 
corresponds to the sequential number n=1. At S6, the 
control device 100 adds one to the curren: sequential 
number n. thereby updating the number n. At S7. the 
control device 100 judges whether the sequential 
number n is greater than a total number. N, of all the 
lighting areas. In the present embodiment, the LEDs 74 
of each lighting device 70 is divioed into four lighting ar- 
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eas, the total number N is equal to 4. Therefore, if S4, 
S5 and S6 are repeated four times, all the image taking 
operations are finished and a positive judgment is made 
at S7. Then, at SB, the control device 100 synthesizes 
the four batches of image data representing the thus tak- s 
en four images, and produces a synthesized image as 
shown in Fig. 6. At S9, the control device 1 00 processes 
the thus obtained synthesized image. More specifically 
described, the control device 100 detects an entire edge 
of a rectangular top surface of the EC 28. determines, 10 
based on the thus detected edge, rotation-position and 
center- position errors of the EC 28 relative to the suc- 
tion nozzle 62 : and produces, based on the thus deter- 
mined errors, correct rotation data indicative of a correct 
rotation angle by which the nozzle 62 is rotated, and cor- is 
reel movement data indicative of respective movement 
amounts by which the mounting head 60 is moved in the 
X-axis and Y-axis directions. Then, at S10, Flag F and 
sequential number n are reset to their initial values, i.e., 
F=0 and n=0, respectively. Thus, all the operations for 20 
one EC 28 are finished. 

[0059] It emerges from the foregoing description that 
in the present embodiment, the suction nozzle 62 pro* 
vides an object holder which holds an object; the plural- 
ity of lighting areas of each of the two lighting devices 25 
70 provide a plurality of lighting devices each of which 
lights the object in a corresponding one of a plurality of 
different directions; each of the two EC cameras 72 pro- 
vides an image taking device; a portion of the control 
device 100 that carries out S1 to S7 of the image 30 
processing program provides a control device which 
controls the lighting devices and the image taking de- 
vice; and a portion of the control device 1 00 that carries 
out SB to S1 0 of the image processing program provides 
an image-data processing device which processes a 35 
plurality of batches of image data representing the re- 
spective images taken by the image taking device. In 
the present embodiment, each of the two lighting devic- 
es 70 includes many LEDs 74 and accordingly functions 
as four lighting devices each of which lights the EC 28 *o 
as the object in a corresponding one of the four direc- 
tions. 

[0060] In the present embodiment, each of the two 
lighting and image-taking devices 80 can light a front 
surface of the EC 28 and take a front-surface image of "5 
the same 28, and the control device 100 can detect, 
based on the thus taken front-surface image, a ciear 
edge of the EC 28. Thus, the accuracy of determination 
of a dimension and/or a position of the EC 28 can be 
sufficiently improved. Moreover, since the front surface so 
of the EC 28 is lighted, the degree of freedom of the 
lighting device 70 is not lowered. 
[0061] In the present embodiment, each of the two 
lighting devices 70 emits light directly from the LEDs 74 
toward tne EC 28 However, the LEDs 74 may be cov- 55 
ereo with e diffusion plaie so that a relatively uniform 
light is emitted from the diffusion piate toward the EC 
26. In addition, the each lighting device 70 may be re- 



placed with one which includes a plurality of light emit- 
ting devices each of which has a point light source which 
radiates light from a point, and an optical system, includ- 
ing a lens, which converts the light into parallel rays. 
[0062] In the present embodiment, each of the divided 
areas of each lighting device has a shape which has a 
wide elevation angle and a narrow azimuth angle. How- 
ever, each divided area may have a different shape. For 
example, each divided area may have a shape which 
has a wide azimuth angle and a narrow elevation angle, 
or a shape having elevation and azimuth angles which 
are substantially equal to each other. 
[0063] In the present embodiment, each of the lighting 
areas is provided by a corresponding one of the divided 
areas, and alt the LEDs 74 belonging to each of the di- 
vided areas are connected to a common switch 76, so 
that all the LEDs 74 can be simultaneously turned on 
and off. However, the size of each divided area may be 
smaller than that of each lighting area, so that a plurality 
of divided areas can cooperate with each other to pro- 
vide a lighting area. In the latter manner, if the way of 
combination of two or more divided areas can be 
changed, then the degree of freedom can be increased 
with respect to the selection of position and/or size of 
each lighting area. Moreover, the latter manner enjoys 
an advantage that each lighting device 70 enjoys a sim- 
pler construction than that of a lighting device which em- 
ploys a plurality of LEDs each one of which is turned on 
and off, independent of the other LEDs. In the latter 
manner, each divided area may be provided by an array 
of LEDs 74 arranged in an elevation angle, an array of 
LEDs 74 arranged in an azimuth angle, or a matrix of 
LEDs 74 having a same number (e.g., two) of LEDs 74 
in each of elevation and azimuth angles. It goes without 
saying that each of the two lighting devices 70 may be 
replaced with a lighting device which employs a plurality 
of LEDs each one of which is turned on and off, inde- 
pendent of the other LEDs. 

[0064] In the present embedment, the four lighting ar- 
eas are so pre-determined as to emit light in the respec- 
tive directions substantially perpendicular to the four 
sides of the rectangular top surface of the EC 28. How- 
ever, the respective shapes and/or respective positions 
of the lighting areas, and/or the total number of the light- 
ing areas may be changed. For example, in the present 
embodiment, the EC 28 having the rectangular top sur- 
face may be lighted by two lighting areas each of which 
emits light in a corresponding one of two directions 
which are, in a plane which contains one of two diagonal 
lines of the rectangular surface and is perpendicular to 
the surface, inclined with respect to the one diagonal 
line such tnat the two directions have respective com- 
ponents each of which is parallel to the one diagonal 
line and wnich are opposite to each other, in this case, 
wher, the EC 28 is lighted by each one of the two lighting 
areas in a corresponding one of the two directions, the 
EC camera 72 takes an image of two shadowed portions 
of vicinity of tne EC 28 that correspond to two sides of 
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the rectangular surface located on one side of the EC 
28 opposite to the each one lighting area. Thus, the total 
number of image taking operations can be reduced. In 
this case, it is preferred that each lighting area have a 
narrow elevation angle and a wide azimuth angle. 
[0065] The foregoing description relates to the EC 28 
which has a simple parallelepiped shape and whose top 
rectangular surface substantially defines an outline 
thereof. However, in the present embodiment employing 
the lighting and image-taking devices 80, the control de- 
vice 1 00 can detect an edge of an EC 28 having a cubic 
shape in which the edge is located inside an outline 
thereof; for example, a package-type EC which is called 
PLCC (plastic leaded chip carrier) and which includes 
J-shaped leads projecting from side surfaces of a main 
body thereof such that respective end portions of the 
leads are located inside an outline of the main body. 
[0066] Fig. 8 shows an object 1 30 (this object may, or 
may not. be an EC) which has a plurality of surfaces (e. 
g., two surfaces) whose edges are to be detected. An 
edge of any one of those surfaces of the object 130 can 
be detected by using the lighting and image-taking de- 
vices 80. An edge 1 34 of the lower surface of the object 
1 30 can be detected by lighting the object 1 30 with par- 
allel lights 132 emitted by LEDs 74 located in a lighting 
area having a great or high elevation angle as viewed 
from the object 1 30; and an edge 136 of the upper sur- 
face of the object 130 can be detected by lighting the 
object 130 with parallel lights 138 emitted by LEDs 74 
located in a lighting area having a small or low elevation 
angle. The edge 136 of the upper surface may be de- 
tected by lighting the object 130 with the parallel lights 
132 emitted by the lighting area having the high eleva- 
tion angle. Thus, any desired edge of an object can be 
detected by selecting a lighting area having an appro- 
priate elevation angle as viewed from the object 1 30. In 
this case, it is preferred that the elevation angle of each 
lighting area be narrow. The object 130 is placed on a 
support surface of a support member, not shown in Fig. 
8. The support member may be the printed board 16 
shown in Fig. 1 . In this case, the F-mark camera 66 may 
be used to take an image of the object and a vicinity 
thereof, and a lighting device similar to the lighting de- 
vices 70 may be employed to light the object 130 sup- 
ported by the support member. 

[0067] Each feature disclosed in this specification 
(which term includes the claims) and/or shown in the 
drawings may be incorporated in the invention inde- 
pendently of other disclosed and/or illustrated features. 
[0068] Statements in this specification of the "objects 
of the invention" relate to preferred embodiments of the 
invention, but not necessarily to all embodiments of the 
invention falling within the claims. 
[0069] The description o' the invention with reference 
to the drawings is by way of example only. 
[0070] The text of the abstract filed herewith is repeat- 
ed here as part of the specification. 
[0071] A method of actecting an edge (134. 136) of 



an object (28, 1 30) including the steps of lighting, in each 
one of a plurality of different directions, at least a portion 
of the object, taking an image (120, 122) of the portion 
of the object and a vicinity of the portion which are light- 
5 ed. in the each one of the different directions, synthe- 
sizing the respective images of the portion of the object 
taken by lighting the portion in the different directions, 
and detecting, based on the synthesized images, an 
edge (134. 136) of the portion of the object. 

10 

Claims 



15 



20 



25 



30 



1 . A method of detecting an edge (1 34, 1 36) of an ob- 
ject (28, 130), said method comprising the steps of: 

illuminating an object from a respective one of 

a plurality of different directions; 

capturing a plurality of images (120, 122) of 

said object, each image being captured whilst 

the object is illuminated from a respective one 

of said directions; 

and 

synthesising said plurality of images and de- 
tecting an edge of said object therefrom. 

2. A method according to claim 1 , wherein each image 
includes an image of at least a portion of a shadow 
cast by the illuminated object. 

3. A method according to Claim 1 or 2, wherein the 
detecting step comprises detecting an entire edge 
of a surface of the object. 



35 4. a method according to Claim 3, wherein the surface 
is a rectangular surface, wherein the different direc- 
tions comprise two first directions which are, in a 
plane which contains one of two diagonal lines of 
the rectangular surface and is perpendicular to the 

*o surface, inclined with respect to said one diagonal 
line such that the two first directions have respective 
components each of which is parallel to said one 
diagonal line and which are opposite to each other, 
or two second directions which are near to the two 

4 5 first directions, respectively, and wherein the meth- 
od comprises capturing images of said ooject, each 
image being captured whilst the object is illuminat- 
ed from a respective one of the first and second di- 
rections. 

50 

5. A method according to any one of Claims 1 to 4. 
wherein the object comprises an electric compo- 
nent (28, 130). 

55 6. Apparatus for detecting an edge (134, 136) of an 
object (28, 130). said apparatus comprising: 

illuminating means (74) for illuminating an ob- 
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ject from one of a plurality of different directions; 
image capturing means (72) for capturing a plu- 
rality of images of said object; 
control means (100) for controlling said illumi- 
nating means and said image capturing means 5 
so that eacn image is captured whilst the object 
is illuminated from a respective one of said di- 
• rections; and 
image processing means (100, 110) for 
processing said images and detecting an edge 10 
(134, 136) of said object therefrom. 

7. Apparatus according to claim 6, wherein said image 
taking means is arranged to capture an image in- 
cluding at least a portion of a shadow cast by the »5 
illuminated object. 

8. Apparatus according to Claim 6 or 7, comprising an 
object holder (62) for holding an object, wherein the 
illuminating means (74) are provided around the ob- 20 
ject holder such that the illuminating means are 
equiangulariy spaced from each other about the ob- 
ject holder, and wherein the image processing 
means is arranged to detect an entire edge of a sur- 
face of an object held by the object holder. 25 

9. Apparatus according to Claim 8, wherein the illumi- 
nating means (74) are provided on a part-spherical 
concave surface whose center is located on a cen- 
terfine of the object holder (62). 30 

10. Apparatus according to Claim 8 or Claim 9, wherein 
the object holder comprises a holding head includ- 
ing (a) a suction nozzle (52) for holding an object, 
and (b) a back plate (63) which has a dark surface 35 
providing a dark background of the suction nozzle. 

1 1 . Apparatus according to any one of Claims 8 to 1 0, 
wherein the object holder comprises a support 
member having a support surface for supporting a *o 
lower portion of an object (1 30). 

12. Apparatus according to any one of Claims 6 to 11, 
wherein said illuminating means comprises a plu- 
rality of light emitting elements (74). 45 

13. Apparatus according to Claim 12, wherein said light 
emitting elements (74) are substantially uniformly 
distributed on a surface and divided into a plurality 

of areas each one of which comprises at least two 50 
light emitting elements. 

14. Apparatus according to Claim 13 ; wherein those 
light emitting elements (74) which belong to a given 
area are unchangeable. 55 

15. Apparatus according to Claim 13, wherein those 
light emitting elements (74) which belong to a given 



area are changeable. 

16. Apparatus according to any one of Claims 6 to 15, 
wherein the control means comprises: 

means for storing at least one program for con- 
trolling the illuminating means and the image 
capturing means; and 

a processor (102) for implementing said pro- 
gram. 

1 7. Apparatus according to Claim 1 6 , wherein the mem- 
ory means (1 04) stores a plurality of different such 
programs, and the apparatus comprises a program 
selecting means (102) for selecting one of the pro- 
grams stored in the memory means. 

18. Apparatus according to Claim 16 or Claim 17, 
wherein the image processing means (100) com- 
prises; 

a plurality of image buffers (1 06) each for stor- 
ing data corresponding to a respective cap- 
tured image; and 

synthesizing means (102) for synthesizing the 
said captured images based on said stored da- 
ta. 
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